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ABSTRACT 

The  stochastic  behavior  of  digital  combinational  circuits  is 
analyzed  by  the  use  of  Walsh  functions.  An  n-input  Boolean  func- 
tion is  represented  as  a Walsh  series  and  the  error  caused  by  noise 
is  measured  in  terms  of  a distance  which  is  the  fraction  of  the  time 
that  the  system  output  due  to  noise-corrupted  signal  differs  from 
that  due  to  signal  alone.  It  is  shown  that  the  error  can  be  ex- 
pressed as  the  sum  of  two  parts:  one  part  depends  only  on  noise 
statistics,  and  the  other  on  both  signal  and  noise.  Some  interesting 
properties  of  both  parts  are  discussed  and  typical  examples  are  given. 
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be  discussed.  The  Boolean  functions  of  two  combinational  circuits  are 


studied,  and  the  system  errors  are  computed  and  plotted  for  various 
statistics  of  signal  and  noise. 


PRELIMINARY  CONSIDERATIONS 


Any  n- input  combinational  circuit,  S,  can  be  represented  by  a 
Boolean  function  that  maps  every  binary  n-tuple  to  either  0 or  1.  Let 
the  set  of  all  binary  n-tuples  be  denoted  by  V . Then 


Since  an  n-tuple  can  be  considered  as  a vector,  it  is  convenient  to  denote 


, x > by  x.  Let  x stand  for  the  integer  whose  binary  repre 


sentatlon  is  x;  we  have 


Equation  (2)  establishes  an  equivalence  between  {0,1,2, ... ,2n-l},  denoted  by 
D , and  V in  Eq.  (1) . Any  function  or  operation  defined  on  V is  thus  also 


defined  on  D . Figure  1 shows  a schematic  diagram  of  an  n-input  combina 


tlonal  circuit  with  a single  binary  output 


Dyadic  operations  are  fundamental  to  Walsh  functions  and  their 


applications.  Dyadic  addition,  denoted  by  e (on  V , and  hence  on  D ) 


is  defined  as  follows 


In  fact,  (Vq,  ©)  forms  the  dyadic  group  for  which  Walsh  functions  are 
the  character  functions  [8]. 


For  an  input  X(t)  - {<X  (t),  X _(t) 


output  of  a given  combinational  circuit  S is  also  a binary  stochastic 
process  (S(X(t))  e {0,1}:  teTh  We  define  a distance  Dg[X(t),  Y(t) ] be 
tween  the  responses  to  two  inputs  X(t)  and  Y(t)  as  the  fraction  of  the 


time  that  the  output  S(X(t))  differs  from  S(Y(t)).  If  X(t)  is  the  signal 
input  process  in  the  absence  of  noise  and  ^(t)  - {<XJ}  n 1(t) , Xj^  n 2<t), 

• ••»  p(t)  > €Vr  : tel}  a noise-corrupted  input  process,  then,  in  general 
S(X(t))  i*  S(X^(t))  and  we  write  the  error  at  the  output  due  to  noise  at 
the  input  as 


A more  precise  definition  for  ^ will  be  given  later. 

We  assume  that  the  noise  is  also  a binary  process  N(t)  = {<N  , (t) 

n-1 

N o^t-)*****  N (t)>  € V : t e T}  and  is  added  to  X(t)  dyadically  to  yield 


The  dyadic  addition  in  Eq.  (5)  is  appropriate  inasmuch  as  a combined  input 
digit  is  in  error  if  and  only  if  the  corresponding  noise  digit  is  1.  Conse 
quently  Walsh  functions  can  be  used  to  advantage  in  noise-error  determi- 


nation 


Walsh  functions,  denoted  by  Wal(*)»  form  an  orthogonal  basis  on 
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V [8]>  [9].  Tor  i € D and  x € V , the  Hadamard-ordered  Walsh  functions  [10], 


[11],  are: 


n-1 

Jo  *1 

Wal(i,x)  - (-1)  J 0 


Where  the  notation  conforms  with  that  In  Eq.  (2).  Obviously,  Wal(i,x)e{l,-l} . 
The  following  properties  can  be  readily  verified  [8],  [12]: 

(a)  Wal(l.x)  - Wal (x , 1)  (7) 


(b)  _l  Wal(i,x)  Wal(j ,x)  - 2n6,, 

xeV 

n 

where  6^  is  the  Kronecker  delta. 

(c)  Wal(i,x  ® y)  - Wal(l,x)  Wal(i,y) 


EQUIVALENT  BOOLEAN  FUNCTIONS  AND  THEIR  WALSH  REPRESENTATION 

Because  Walsh  functions  form  an  orthogonal  basis  on  V , we  can 

n 

represent  any  Boolean  function  as  a Walsh  series.  We  write,  for  any 
n- Input  Boolean  function  S, 


where 


S(x)  = l b Wal(i,x) 

J * 


b±  - 2-n  J S(x)  Wal(l,x) 


Two  Boolean  functions  S^x)  and  S2(x)  on  Vn  are  said  to  be  equivalent  [13] 

if  there  is  a sequence  of  permutations  and  complementations  of  some  of 

the  variables  <x  x x > to  produce  <y  y y > such  that 

n-x  n-z  o n-i  n-z  o 


for  every  x e Vn, 


S2(y)  © S2(x)  - d , for  d e {0,1} 


Assertion  I (See  Appendix  I for  proof.) 


Let  an  n- input  Booiv  an  function  S(x)  as  represented  in  Eq.  (10) 
be  transformed  under  an  equivalence  operation  (permutations  or  comple- 
mentations) to 


q.  Wal(i.x) 


(a)  If  Q(x)  Is  the  complement  of  S(x),  then 


(c)  If  x and  xR  (0  _<  a, $ < n)  are  interchanged,  then 


for  those  i where  i # i 


This  assertion  will  be  used  to  prove  that  the  part  of  the  error  which  depends 
only  on  noise  statistics  is  invariant  over  complementations  in  Boolean 
functions  and  over  an  interchange  of  inputs  under  certain  conditions. 


NOISE  ERROR  IN  COMBINATIONAL  CIRCUIT 


We  have  defined  previously  a distance  D fX(t),  Y(t)]between  the 


responses  of  a combinational  circuit  S to  the  inputs  X(t)  and  Y(t)  in  a 


qualitaCive  manne.  . For  stochastic  inputs  over  a discrete  time  domain  T 


l [S(X(t))  © S(Y(t))]> 
tcT 


where  D [.,.]  satisfies  the  following  properties 


Combining  Eqs.  (4),  (17)  and  (10),  we  have  the  following  Walsh  reptesenta 


tion  for  the  error  at  the  output  of  the  combinational  circuit  S for 


l [ l b±  Wal(i,X(t))  - l b.  Wal(i,XN(t))]Z  } (21) 


(a  - b;  for  a,be{0,l}  has  been  used.  The  following 


where  the  identity  a©b 
relations  hold: 


E{ [1  - Wal(i,N(t))]  } = 2 (1  - E[Wal(i,N(t))] } 


which  vanishes  if  i = 0;  and 


E{ [1  - Wal(i,N(t))]  [1  - Wal( j ,N(t) ] } = 0 


if  i or  j = 0.  By  using  Eqs. (5), (22)  and  (23),  we  can  put  Eq.  (21)  in  the 


following  form 


b.  [l-E(Wal(i,N(t))}] 


which  depends  only  on  noise,  and 
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C- (N,X)  = 4r  l l l b b E{ [1  -Wal(i,  N(t))] 
5 • |T|  tcT  i*J:i,j€D  1 J 


• [1  - Wal( j , N(t)) ] • Wal(i  © j,  X(t))} 


which  depends  on  both  signal  and  noise.  Note  that  D may  be  replaced  by 

n 

D - {0}.  Equations (24) -(26)  are  general  results  for  system  errors, 
n 

Under  the  complementation  operations  in  Assertion  I:(a),(b),  which 

2 2 

transform  S to  Q,  Eqs.  (14),  (15)  indicate  that  q^  = b^  for  i # 0.  Hence 
F (?J)  = F (N) . Furthermore,  using  Eqs.  (16)  and  (25)  we  have 

Q s 


£n(N)  = -fir  l l b?  [1  - E{Wal(i,  N(t))}] 
w 111  teT  i =in 


+ rJr  ll  b?  tl  - E{Wal(i  ©2a©23,  N(t) ) }]  (27) 

111  teT  i Ua  1 

a 6 

Now,  in  view  of  Eq.  (9),  if  N^(t),  N^(t)  are  identically  distributed  and 
independent  from  the  other  noise  processes, 

i N (t)  + i„NR(t) 

E{Wal[i  ®2a©  23,  N(t)]}  = E{Wal[i,  N(t)  1 } • K{ (-1)  a a p **  } (28) 


} (28) 


Since  exactly  one  out  of  (i  , iQ}  will  be  1 if  i ^ i , and  since 

Ot  p (X  p 


N (t)  N (t) 

(-1)  “ and  (-1)  P 


have  the  same  mean,  it  follows  from  Eqs.  (25)  and 


(27)  again  that  £ (N)  = £ (N) . Hence,  we  can  make  the  following  assertion. 


Assertion  II 

For  a given  combinational  circuit  S,  the  noise-dependent  error  term 
£S(N)  is 

(a)  invariant  under  a complementation  of  its  Boolean  function  and/or  a 
complementation  of  any  subset  of  the  inputs,  and 

(b)  invariant  under  an  interchange  of  inputs  xa(t)  and  x^(t)  if  the  noise 


probabilities  of  N (t)  * 1 and  of  N„(t)  * 1 are  equal 


ERROR  FOR  INDEPENDENT  AND  STATIONARY  INPUTS 


The  noise-error  formulas  in  Eqs.  (25)  and  (26)  are  quite  involved 


and  it  is  difficult  to  interprete  the  dependence  of  £C(N)  and  £C(N,X)  on 


We  shall  now  show  that  when 


the  signal  and  noise  are  independent  and  stationary  processes,  each 


identically  distributed,  £ (N)  is  expressible  as  a polynomial  in  the  ex 


pected  value  of  the  noise  and  £ (N,X)  as  a polynomial  in  the  expected 


values  of  the  signal  and  the  noise.  Preparatory  to  the  substantiation  of 


this  statement,  we  first  need  to  establish  a lemma 


Lemma  (See  Appendix  II  for  proof) 


If  X,  c {0,  1}  are  Independent  and  identically  distributed  binary 


random  variables  (0  £ j < n)  with  Prob.  (X,  * 1)  ■ 6 , then 


E{Wal(i,X) } - (1  - 2 5V) 


where  Hm(i)  denotes  the  Hamming  weight  of  1 


Under  the  assumption  that  the  signal  and  noise  are  independent  and 


stationary  processes,  each  identically  distributed,  we  obtain  the  follow- 


ing Important  simplified  results  from  Eqs.  (25)  and  (26)  immediately,  with 
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Assertion  III 


If  {X1(t),  N±(t) : 0 < i < n}  are  independent  and  stationary  with 


Prob[X1(t)  - 1]  - E{Xt}  - 6X 

and 

ProbfN^t)  - 1]  - E{N1>  - 6n 


(31) 

(32) 


then  the  component  error  expressions  £ (N)  and  £ (N,X)  in  Eqs.  (25)  and 

b b 

(26)  for  the  Boolean  function  S represented  in  Eq.  (10)  can  be  simplified 
respectively  to: 


and 


CS(N)  “ 2 l b*[l  - PJJm(1)] 

s ieD  1 N 

n 


(33) 


5S(N,X) 


i i b.b.ti  + P?“(1  © pf «>-  pfojjpfcuej) 

irj : i,  jeD  1 J N N NX 

n 


(34) 


where 

px  " 1 - 26x  (35) 

and 

PN  " 1 ' 26n  (36) 

and  Dn  may  be  replaced  by  Dn  - {0}.  Note  that  ^ (N)  in  Eq.  (33)  is  a 

polynomial  in  the  expected  value  of  the  noise  and  that  £ (N,X)  in  Eq.  (34) 

S 

is  a polynomial  in  the  expected  values  of  the  signal  and  the  noise.  Both 

are  relatively  simple  to  compute  and  their  sum  can  be  plotted  versus  6 for 

N 

different  values  of  6X  for  a given  combinational  circuit. 


SPECIAL  SITUATIONS 

We  now  examine  the  behavior  of  the  error  for  three  special  situ- 
ations; namely,  (A)  the  low-noise  case,  (B)  the  case  of  6„  - 0.5,  and 

N 

(C)  the  unbiased-signal  case. 


In  such  a case,  we  can  use  the  approximation 


and  write  Eqs.  (33)  and  (34)  as 


where,  for  0 < k < n 


l l b b ,[Hm(i)  + Hm(j)  - Hm(i  © j)J 

i.ie^  1J 

Hm(i  © j)«k 


Substituting  Eqs.  (38)  and  (39)  in  Eq.  (24),  we  have 


Hence  we  can  conclude  from  Eq.  (41)  that  in  a low-noise  situation  the 


error  increases  approximately  linearly  with  6 


the  constant  of  pro 


portionality  being  a polynomial  in  p . This  conclusion  is  exhibited  in 


Note  that  £ is  independent  of  the  signal  if 
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! 


Substitution  of  Eq.  (42)  in  Eq.  (34)  and  then  combining  with  Eq.  (33), 
we  obtain 

= + VN’X)  " £ ck  px  (43) 

k*0  K A 

where 

CQ  = 2 l *1  <«  ^(N))  (44) 

° iCD  -{0}  iS 
n 

and 

ck  = l l » 1 < k < n (45) 

k i,jeDn-{0}  ij 

Hm(i@>  j)=k 

Hence  Cg  is  a polynomial  in  px  as  in  Eq.  (41).  is  independent  of 
signal  X(t)  if  and  only  if  c^  * 0 for  1 < k <_  n. 

(C)  The  unbiased-signal  case 

In  many  situations  the  signal  has  no  bias,  or  the  environment  is 

not  known;  it  would  be  reasonable  to  assume  6 = 0.5  or  p * 0.  Hence 

X X 

£g(N,X)  = 0 and 

5S  - Es«0  - 2 b*[l  - pj"'1’)  (46) 

n 

The  error  is  then  invariant  over  each  equivalence  class. 

NUMERICAL  EXAMPLES  AND  ERROR  CURVES 

We  shall  now  apply  the  method  developed  in  the  previous  sections 

to  determine  the  error  at  the  output  of  two  combinational  circuits  as  a 

function  of  the  expected  values  of  the  signal  and  the  noise  at  the  input. 

Both  the  signal  and  the  noise  component  stochastic  processes  are  assumed 

to  be  independent  and  stationary,  each  being  identically  distributed. 

The  error  £ will  be  calculated  and  plotted  versus  6 , for  different 
D N 
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values  of  6X»  Two  sets  of  error  curves  (one  set  for  lov-nolse  and  the 
other  set  for  hlgh-noise  situation)  are  presented  for  the  Boolean  func- 
tion of  each  combinational  circuit. 


Circuit  1 - A 3-input  function:  S(x)  = x^x^  + x^Jxq  + x2xl* 

For  this  Boolean  function,  S(x)  = 1 for  x€r2,4,6,7}  and  the  vector  b 
representing  the  coefficients  b.,  (i  - 0,1,..., 7)  of  the  Walsh-series  expansion 
in  Eq.  (10)  is  found  by  Eq.  (11)  to  be 

b = 2-2[2  1-10-100  -1] 

In  order  to  examine  the  behavior  of  the  error  curves  in  both  the  low-noise 

and  the  high-noise  situations,  the  e coefficients  in  Eq.  (40)  and  the  c, 

K-  k 

coefficients  in  Eqs.  (44)  and  (45)  are  computed. 


eQ  = 0.75,  e1  = e3  = 0,  e2  = 0.25 

c = 0.50,  c = c„  = c,  = 0 
o 12  3 

vs.  6n  curves  are  plotted  in  Figs.  2(a)  and  2(b).  It  is  seen  that  in 
the  low-noise  range  increases  almost  linearly  with  6N  and  is  dependent 
on  5^  because  e2  is  non-zero.  In  the  entire  high-noise  range,  fjg  depends 
minimally  on  6Y  and  becomes  independent  of  6 at  6 =0.5,  in  agreement  with 
the  c^'s  being  zero  for  k ^ 0.  The  error  curves  are  monotonically  increasing. 


and  thus  a maximum  uncertainty  (5^=  0.5)  does  not  cause  a maximum  error.  The 
compactness  of  both  the  low-noise  and  the  high-noise  error  curves  is  apparently 
due  to  the  sparseness  of  the  vector  b. 
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Circuit  2 - A 4-input  function  S(x)  - x^x^XjQ^Xq)  + (x3©x2>x’x^  + (x^  + XjXpXjXg . 

Here,  S(x)  «1  for  xc{l,2,3,4,7 ,8,11},  and  the  vector  b Is 

b - 2— 4 [ 7 -1-13  3 -1  -1  -1  3 -1  -1  -1  -1  -1  -1  -51 

and  the  e^  and  c^  coefficients  are: 

eQ  - 1.250,  ex  - 0.750,  e2  - 0.250,  e3  « -0.250,  - 0 

cq  - 0.492,  c1  » 0.0312,  c2  = -0.0156,  c3  --0.0312,  c --0.0391 

Ks  vs.  6n  curves  are  plotted  in  Figs.  3(a)  and  3(b).  In  the  low-noise 
range,  increases  almost  linearly  with  6 The  slope  of  the  error  curves 
decreases  fairly  linearly  with  increasing  6 Y;  hence  the  low-noise  error  is 
upper-bounded  by  the  SY  * 0 line.  This  linear  dependence  on  8V  results  from 
the  dominance  of  e3  over  the  other  e^'s.  The  high-noise  curves  demonstrate 
two  phenomena:  firstly,  heavily  biased  signals  (6  *>  0.001,  0.01,  0.90,  0.99) 

A 

suffer  less  error  with  greater  noise  above  6N  * 0.5;  secondly,  the  value  of 
6n  at  which  the  maximum  error  occurs  increases  with  increasing  6X«  This 
complicated  behavior  is  a hallmark  of  the  absence  of,  or  having  few,  zero 
Walsh  coefficients  (b^'s). 

CONCLUSION 

This  report  presents  a procedure  for  analyzing  the  stochastic  behavior 
of  digital  circuits  by  the  use  of  Walsh  functions.  In  particular,  the  error 
at  the  output  of  a combinational  circuit  caused  by  noise  is  studied  by  de- 
fining a distance  measure  between  the  responses  to  the  signal  and  to  the 
noise-corrupted  signal.  Restricting  the  noise  to  be  dyadically  additive, 
which  is  perfectly  reasonable,  Walsh  representation  is  used  to  obtain  the 
error  in  terms  of  the  input  statistics.  It  is  shown  that  the  error  can  be 
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expressed  as  the  sum  of  two  parts:  one  part  depends  only  on  noise  statistics , 
and  the  other  on  both  signal  and  noise.  The  former  is  Invariant  for  equiva- 
lent Boolean  functions  if  the  noise  processes  are  Independent  and  identically 
distributed.  Under  the  more  constrained  condition  of  Independent  and  stationary 
noise  and  signal  processes,  each  identically  distributed,  the  error  is  a poly- 
nomial function  of  the  expected  values  of  signal  and  of  noise.  In  low-noise 
situation,  the  error  increases  linearly  with  the  expected  value  of  the  noise 
at  the  input.  For  unbiased  signals  the  error  polynomial  is  invariant  over 
each  equivalence  class.  These  properties  are  exhibited  in  two  typical  ex- 
amples. 


APPENDICES 

(I)  Proof  of  Assertion  I 
k (a)  By  hypothesis, 

Q(x)  - 1 - S(x)  (A-l) 

Using  Eq.  (10)  and  the  fact  that  Wal(0,  x)  = 1,  we  have 


Q(x)  - Wal(0,  x)  - l b Wal(i,x) 

ieD  1 
n 

- (1  - b ) Wal(0,x ) - l b.  Wal(i,x)  (A-2) 

° icD  -{0}  1 

n 

Comparison  of  Eq.  (A-2)  with  Eq.  (13)  proves  Eq.  (14). 


(b)  Complementing  the  m inputs  changes  x to  y » x 0 h with  h given  by 

Eq.  (15a)  which  implies  h « 1 for  all  k.  As  a result  , 

Jk 
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Q(x)  - S(y)  - S (i  © h) 


- I b Wal(l,  5 © h) 
l€D 

n 

- I [b.  Wal(l,  h)]  Wal(i,x) 

j A 


(Ar3) 


from  which  Eq.  (15)  follows  directly. 


(c)  Interchanging  xQ  and  changes  x to  y and 


Q(x)  - S(y)  - l b Wal(i.y)  + [ b.  Wal(i.y) 

VS 


(A-4) 


(c-1)  If  io  - ig,  Wal(i.y)  “ Wal(i,xJ.  Thus,  = b^ 

(c-2)  If  i i ifl,  then  for  j * i © 2a  © 2^,  j + j . We  have 

up  CX  P 


Wal(i,y)  - Wal(j,x),  and  Wal(j,y)  = Wal(i,x). 


Thus,  q£  - bi©2“®2g‘ 


Equation  (16)  is  therefore  proved. 


(II)  Proof  of  Lemma 

We  note  from  Eq.  (6)  that  only  those  x^'s  corresponding  to  i^  = 1 
will  have  an  effect  on  the  value  of  Wal(i,x).  If  the  Xj'8  are  independent 
and  identically  distributed,  any  collection  of  that  many  X^'s  will  suffice 
for  probability  calculations  for  Wal(i,X).  Thus, 


Prob  [Wal(i,X)  - 1]  - Prob[( 


ta(i) 

l X ) 

j=l  J 


is  even] 


ftn(i)  Hm(i) 

8 I Prob  [(  l X.)  - w] 

w*0  j=l  J 

(w  is  even) 

Hm(i)  /Hm(i)\ 


(A-5) 


w=0 

(w  is  even) 


pd^v^^HmdW 


Similarly 


Hm(i) 


Prob  [Wal(i.X)  - - 1]  - Prob  [(  £ X.)  is  odd] 

j-1  J 

Hm(i)  /Hm(i)  \ 

’ JL  ( H) 

(w  is  odd) 


!(1-V 


Hm(i)-w 


Combining  Eqs.  (A-5)  and  (A-6),  we  have 


E[Wal(i,X)]  - Prob  fWal(i,X)  = 1]  - Prob  [Wal(i,X) 


- (1  - 2Sx)Hm(i) 

which  is  Eq.  (29),  the  lemma  to  be  proved. 
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